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ae mote gives a justification for the interchange of limiting pro- 
cessee required in Doob's “heuristic” approach to the Foluogorovy limiting 
distribution of the maximum deviation between a theoretical anf an empirical 
distribution fumeticn. , /N\ 

A number of writers care eel. treated the Kolmogoro'’-Sairnoy 
Lined t ing ‘Meteibatines from point of view of stochastic processes. 


( 1 , 2 , am 3 .) For jexample, let 


where F(x) ‘9 an argitrary comtinuous cumulative distribution and the 

random variable F (2) le the sample cummlative: uF (z) is the mmber of 

values which are < x in a sample of m from a population described by P(x). 
Sfypoe the limiting ¢istribution of De {es the samo for ary continuous 


F, ({t 1e euffiolent to let F(t) = t, O< t <1, amd to consider 
u(t) = va (P(t) - t), Oo<t<i, 
where the n sample values are picked according to the wmiiform d!stributian 


an (0,1). For amy fixed set of values t,, ..., t the joint distribution 


of wa(ti) sees w(t) approashes that of y(t,), ..., x(t, ) esn—-~ , where 


y(t) te the Gaussian process defined by 
y(t) = x(t) - tx(1), 


x(t) beimg the Wisner process. This is the heuristic guide to the fact 
showa by Dood 2 that the limiting distritution of Da ie the sam as 


tke distribution of 


D= sup [y(t 
ogt<l 


It cppeers worthvhile to give ea simple and rigorous | wtifioation 
for the transition fras Dd. to D. Snohk questions come up frequently, and 
are alsc cf some theoretical interest in commestion with "Momte Carlo” 
procedures where continuous stookastic processes are approximated with 
reador walks. 

Let 


@(r) = P(D < 8) 


8, (2) -P(D. &< s) =P se w(t) <*% 
We vieh tc show that for any z, 


(1) lim 8, (") =» Of). 


The desired reaul?t will follow from Theore 1. 


Theorem 1. Let a and b be arbitrary positive mmbers. Then n and . > 0 


> 


ee eee cee ee 


Pp. 4 Maz (tg) - t, ) >a} <r 
O<cti<t<str+h 91 a s(t) . 


We make use of an idee going back to W. K. Clifford 1866; see 


Morar & . This is the fact that if T,, -.+) Ty), are independent 


ie] 


random variables eauh having th: density oe ‘ for anyc > OC, the quantities 


T ie hs oF are jointly distributed like the n¢) intervals which 


eel! 
are obtained whem n pointe are picked uniformly and independently at random 
on the interval (0,1). Im other vords let a(t) be a Poisson procese with 
rate n; i.e., the provability of a jump of + 1 between t ami t + dt is 

mit + 0(dt)?. Let L, be the time vhen the (m41) st juxp oocurs. Then the 
two stochastic processes F(t) and 0 {L t) are equivalent for t im (0,1). 
Now for large n, Le convergue stochastically to 1, ani thus to prove theore: 


1 we consider first a(t). 


Let 
v(t) = Vn [G(t)/a-t 
| 
( \ = P Max iy_(t)) >a 
ea Oc tego 
\ ; is 
Lom: a n' : —— | ‘s 
, Vex fa/\2 A 


for a >n(a, |). 
Thie lemma could be strengthened by gemerel methods used by Ervios and 
Fao 6S, «(but the following simple derivation is sufficient here. Let 


T be the emal_est t-value for which v(t) >a, let Kan (? be the oumulative 


distribution of T and let 


G_-(%) =» P v,,6*) >a 


Iv 


2. 
(2) Q(2 0) i Q(2 0-7) ak (7) 


2) 


Iv 


oD) 
/ Qa(2 a - 7) aK) 


The firet > sign in (2) appears because v,,(*) {fe 3s discontinnous differential 


prosess; for a contiguous differemtial process equality would hold. Wow 
Saale (BRS Net +H i 6 dy 
\Px 
“al \2p 


ann, amd (a) 5 mifommly tno for sso <2, Hence (2) 


implies that 


i 
~ -iy 

=a . * ay > Ek ( NN) 
Naf (a 


form >a(a, \ ). A similar argument applies to 


Re -es Min v(t) <- A ; 
Oo<tcaA | 


ond the lem. follows from the obvious fact that 


* 
pwns a \ 

E CS <k (a) +X CE\. 
, gtamdard type of argument now telis us tbat theorem 1 holds if w(t) 


is replaced by W(t) For we may divide the interval (0,1) imto & equal 


parts of length 
t) differ from ite initial vaize om that interval by more than f 1e 


The probability that on none of these intervals does 


Pr lr 


7 | 


= x erall encugh so that 


we may then choose “4 
) 


for n>n_. Theorem 1 now holds for ie , with the quantities a, », i 


and n, tust chosen, since with probability > 1 - b, v(*) has no oscillations 
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> 3 im any of the intervals (4+ , 2) amt tims no oscillations > a in any 


interval of length se 


Row 
/ QO (L_t) : 
(3) vA(Lt) = Ya ( BP A- -re - alt) ets 
where the randou variable Be 


{g asymptotically nc 71 with zero mean and unit variance. 

It is eas'ly seen that theorem 1 must alo hold om (0,1) for the randae 
function va(L,*), which {a produced from vA t) by a vaniom magnification of 
the t-scale; for an arbitrary o > 0 we can make the probab.lity arbitrarily 
high, by taking n large emough, that the magnification La ia tetween l-o 
end lec. Theorem 1 likewlee holds °or the random fimotion t Cai it aust 


tserefore hold for the diffarence 


w(t) = Wilt) - th. 


The following scheme now gives (1). 


Def ine 


(0 8) 
+= | 
~~ 
ye 
— 
8 
2) 
-~ 
co 
3 
lA 
a] 


t (ty) = Pf eup y(t) <1 


Ak eae sup ya), <4 


We use the known result that {(2) is comtimucus. Ls*% 2 > 0 amd a> 0 be 


<afr. 


given. Pick ~ > Oo that | b | <- implies | #(2) - ieee an)) 


Then, using theoorwa 1 and observing thit 


we may, by theorem 1, piok n' and &r' so that n>n', k > k', implies 


i 
) - A (2) 
HA es lit + afr, 


Next pick k” >k' eo that k > k" implies 


(a) - va) | <afs, 

“Ve yes ea, 
Then chy se nm" > n' wo that n > n* ixplice 

ao - a (a)! < af, 

rat 6) +e (2-2 )| <af 


Por all a > n” we them have 
(4) y{s) < y(s- pj) +af< pP(n- pj) +af< 


ax (a - +) #3afh ce (2) a, 
(9) y(t) > (2) - afh > OF (a) - a/2 20,(2) - af. 
Fron (4) and (%) it follows that for all n > n" 


W(t) - ag Ole) < ¥(e) + a/2 


ami this establishes (1). 
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